Independent Slow Feature Analysis and Nonlinear Blind Source Separation
نویسندگان
چکیده
In the linear case statistical independence is a sufficient criterion for performing blind source separation. In the nonlinear case, however, it leaves an ambiguity in the solutions that has to be resolved by additional criteria. Here we argue that temporal slowness complements statistical independence well and that a combination of the two leads to unique solutions of the nonlinear blind source separation problem. The algorithm we present is a combination of second-order Independent Component Analysis and Slow Feature Analysis and is referred to as Independent Slow Feature Analysis. Its performance is demonstrated on nonlinearly mixed music data. We conclude that slowness is indeed a useful complement to statistical independence but that time-delayed second-order moments are only a weak measure of statistical independence.
منابع مشابه
Nonlinear Blind Source Separation by Integrating Independent Component Analysis and Slow Feature Analysis
In contrast to the equivalence of linear blind source separation and linear independent component analysis it is not possible to recover the original source signal from some unknown nonlinear transformations of the sources using only the independence assumption. Integrating the objectives of statistical independence and temporal slowness removes this indeterminacy leading to a new method for no...
متن کاملAn extension of slow feature analysis for nonlinear blind source separation
We present and test an extension of slow feature analysis as a novel approach to nonlinear blind source separation. The algorithm relies on temporal correlations and iteratively reconstructs a set of statistically independent sources from arbitrary nonlinear instantaneous mixtures. Simulations show that it is able to invert a complicated nonlinear mixture of two audio signals with a high reliab...
متن کاملDiagonalization of time-delayed covariance matrices does not guarantee statistical independence in high-dimensional feature space
Independent Slow Feature Analysis (ISFA) is an algorithm for performing nonlinear blind source separation, which combines linear ICA with Slow Feature Analysis (SFA). In its current form the objective function is based on time-delayed covariance matrices. While the algorithm performs well in general, we occasionally encountered cases in which the estimated sources are highly statistically depen...
متن کاملFast Independent Component Analysis in Kernel Feature Spaces
It is common practice to apply linear or nonlinear feature extraction methods before classification. Usually linear methods are faster and simpler than nonlinear ones but an idea successfully employed in the nonlinearization of Support Vector Machines permits a simple and effective extension of several statistical methods to their nonlinear counterparts. In this paper we follow this general non...
متن کاملSpectral Analysis of Speech: A New Technique
ICA which is generally used for blind source separation problem has been tested for feature extraction in Speech recognition system to replace the phoneme based approach of MFCC. Applying the Cepstral coefficients generated to ICA as preprocessing has developed a new signal processing approach. This gives much better results against MFCC and ICA separately, both for word and speaker recognition...
متن کامل